Voice-Driven Computer Game in Noisy Environments

The paper describes the performance of a task-oriented continuous automatic speech recognition (ASR) system in the computer game interface in noisy conditions. First, the process of designing the ASR system for Polish, based on CMU Sphinx4, is presented. Then, the concept of the computer game called Rally Navigator is described. The experiments were first run for the clean speech, and then repeated with added environmental noise with various signal-to-noise (SNR) ratios. Results of experiments with clean speech show that as little as 15 minutes of audio material is enough to produce a highly effective single-speaker command-and-control ASR system for the computer game, providing the sentence recognition accuracy of 97.6%. Results of the tests under noisy conditions show that minor degradation of performance was observed in car environment, however, accuracy decreased severely for babble and factory noises for SNR below 20 dB.